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FOREWORD 


The  research  leading  to  the  development  of  these  Research  Products  was  begun 
under  RDTE  Project  Number  2Q762772A764 ,  ARI  FY  78  and  79  Work  Program  (Train¬ 
ing  and  Education).  The  results  of  these  efforts  were  fed  into  subsequent 
research  conducted  under  RDTE  Project  Number  2Q263744A795,  ARI  FY  80  Work  Pro¬ 
gram  (Training  Simulation).  The  final  research  was  conducted  by  the  Learning 
Systems  Institute  of  Florida  State  University  under  contract  number  MDA  903- 
80-C-0218 . 

• 

The  research  had  as  its  major  objectives  to  assess  current  models  and  the 
state  of  the  art  in  selection  of  alternative  instructional  delivery  systems, 
to  determine  the  type  and  extent  of  problems  encountered  in  applying  existing 
models,  and  to  recommend  changes  and  improvements. 

The  research  is  directly  responsive  to  the  expressed  needs  of  the  Army  Training 
Support  Center  (ATSC)  of  the  Training  and  Doctrine  Command  (TRADOC) . 

Research  Product  81-25A  describes  the  theoretical  background  of  the  research 
in  selection  of  Instructional  Media. 

Product  81-25C  presents  the  Model  itself,  its  attendant  flowchart,  and  Users 
Guide . 


Mr.,  T.J.  Houston  of  the  Simulation  Systems  Technical  Area  served  as  COR  for 
this  research. 
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A  LEARNING -BASED  MODEL  FOR  MEDIA  SELECTION:  DEVELOPMENT 


EXECUTIVE  SUMMARY 


Requirement: 

This  report  describes  a  project  that  was  conducted  in  order  to  collect 
information  about  instructional  media  selection  procedures  and  problems  in 
the  U.S.  Army  and  to  recommend  means  of  improving  the  media  selection 
process. 


Procedure: 

In  order  to  identify  procedures  and  problems,  four  Army  schools  were 
visited  and  29  instructional  developers  who  made  media  selection  decisions 
were  interviewed.  After  procedures  and  problems  were  identified,  a  new 
media  selection  model  was  developed.  The  model  was  revised  several  times. 
The  first  revision  was  based  upon  feedback  from  12  instructional  designers 
(eight  faculty  and  four  graduate  students)  at  Florida  State  University  who 
were  asked  to  review  the  model.  Subsequent  revisions  were  based  upon 
formative  evaluation  data  collected  from  six  graduate  students  in  instruc¬ 
tional  design,  six  instructional  developers  at  Fort  Gordon,  and  five 
instructional  developers  at  Fort  Rucker. 


Findings : 

A  systematic  means  of  selecting  media  is  rarely  used.  An  existing 
media  selection  model  that  is  perceived  as  too  complex  often  leads  to  the 
selection  cf  media  based  on  convenience  and  the  developer's  intuition  and 
experience.  However,  the  majority  of  Army  instructional  developers  who 
reviewed  the  new  media  selection  model  indicated  that  there  was  a  high 
probability  that  it  would  be  used  on  the  job. 


Utilization  of  Findings: 

Whether  instructional  developers  in  the  Army  use  the  model  depends 
largely  upon  whether  the  model  is  properly  disseminated.  If  the  model 
is  disseminated  properly,  it  could  have  a  very  positive  effect  upon  the 
media  selection  procedure  used  in  the  Army. 
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A  Learning-Based  Model  for  Media  Selection:  Development 


In  January,  1980,  the  Center  for  Educational  Technology  (CET)  at 
Florida  , State  University  was  awarded  a  contract  with  the  U.S.  Army 
Research  Institute  (ARI)  to  collect  Information  about  Instructional  media 
selection  procedures  and  problems  in  the  Army  and  to  recommend  means  of 
Improving  the  media  selection  process.  Specifically,  the  tasks  of  the 
contract  were: 

(1)  Identify  and  document,  at  selected  local  sites,  current  formal 
and  informal  procedures  for  implementing  decisions  on  selecting 
instructional  delivery  systems. 

(2)  Determine  problems  encountered  by  Instructional  decision  makers, 
In  following  the  procedures  identified  in  Task  1. 

(3)  Categorize  and  analyze  the  problems  encountered. 

(4)  Based  upon  analysis  in  Task  3,  make  specific,  detailed,  feasible 
recommendations  for  steps  to  improving  media  selection  for  local 
(School)  implementation  ( 1 .e. ,  develop  guidelines  for  "how  to  do 
it"). 

This  report  will  describe  the  contract  activities  the  CET  staff 
undertook  and  will  present  the  results  of  those  activities. 


Preliminary  Activities 

During  the  first  six  months  of  the  contract,  members  of  the  CET  staff 
visited  four  Army  schools  in  order  to  (a)  identify  the  instructional  media 
selection  procedures  followed  at  those  schools  and  (b)  identify  the 
problems  instructional  developers  face  in  selecting  instructional  media. 
Prior  to  visiting  the  schools,  the  CEY  staff  developed  two  questionnaires 
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designed  to  be  used  during  the  visits  to  the-schools.  The  first  question¬ 
naire,  referred  to  as  the  general  Information  questionnaire,  consisted  of 
three  parts: 

(a)  a  background  information  sheet,  asking  the  respondent  to 
describe  his  current  job  duties  and  tasks,  as  well  as  his 
training  for  that  job; 

(b)  a  media  availability  and  selection  questionnaire,  asking  the 
respondent  to  indicate  whether  various  media  were  available 
for  him  to  choose  as  a  means  of  delivering  Instruction,  and, 
if  the  medium  was  available,  how  frequently  the  respondent 
chose  that  medium; 

(c)  a  learning  categories  questionnaire,  asking  the  respondent  to 
indicate  what  learning  categories,  if  any,  the  respondent  used 
in  order  to  classify  types  of  learning. 

A  copy  of  the  three  parts  of  the  general  information  questionnaire  Is 
contained  in  Appendix  A. 

The  second  questionnaire  developed  for  this  contract,  referred  to  as 
the  Interview  questionnaire,  consisted  of  four  parts: 

(a)  a  set  of  questions  about  the  instructional  development  and 
media  selection  procedures  the  respondent  followed; 

(b)  a  set  of  questions  about  the  media  selection  guidelines  the 
respondent  used; 

(c)  a  set  of  questions  about  the  media  selection  problems  the 
respondent  encountered; 

(d)  a  set  of  questions  asking  the  respondent  to  identify  appro¬ 
priate  solutions  to  the  media  selection  problems  he  faced. 

A  copy  of  the  four  parts  of  the  interview  questionnaire  is  contained  in 

Appendix  B. 

After  the  questionnaires  were  developed,  members  of  the  CtT  staff 
visited  four  Army  schools.  These  schools,  whicn  were  visited  during  March 
and  April  of  1980,  included  the  Engineers  School  at  Fort  Belvoir,  the 
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Intelligence  School  at  Fort  Devens,  the  Signal  School  at  Fort  Gordon,  and 
the  Aviation  School  at  Fort  Rucker. 

At  each  school i  the  Directorate  of  Training  Developments  Identified 
those  Individuals  most  heavily  Involved  In  the  media  selection  process. 
During  a  group  meeting,  each  of  these  Individuals  was  asked  to  complete  the 
general  Information  questionnaire.  CET  personnel  reviewed  the  responses  to 
these  questionnaires  and  then  conducted  individual  interviews  with  those 
respondents  whom  they  felt  could  provide  the  most  useful  additional 
information.  A  total  of  49  individuals  responded  to  the  general  Infor¬ 
mation  questionnaire.  Of  this  number,  29  individuals  were  selected  to  be 
interviewed  on  an  individual  basis.  A  summary  of  the  responses  to  the 
general  Information  questionnaire  is  contained  in  Appendix  C.  Appendix  D 
contains  a  summary  of  the  responses  to  the  interview  questionnaire. 


Current  Media  Selection  Procedures 

Based  upon  the  responses  to  the  interview  questionnaire,  the  following 
statements  can  be  made  regarding  the  media  selection  procedures  used  at  the 
schools. 


1)  No  set  of  guidelines  for  media  selection  is  regularly  used. 

The  most  common  media  selection  model  mentioned  was  the  model 
contained  in  ISD  Phase  III. 2.  However,  this  model  was  considered 
by  most  developers  to  be  too  complicated.  Only  one-third  of 
those  interviewed  indicated  that  they  were  influenced  by  ISD  in 
selecting  a  medium  for  instruction,  and  many  of  these  individuals 
indicated  they  did  not  strictly  adhere  to  the  ISD  guidelines. 

2)  Media  selection  decisions  are  often  made  in  advance  of  develop¬ 
ment  activities.  This  "preselection"  of  the  medium  or  delivery 
system  is  the  result  of  a  number  of  different  factors,  including 
school  policy,  the  preferences  of  instructional  and  administra- 


4 


tlve  staff,  cost,  and  availability.  For  example,  standard  policy 
at  one  school  visited  was  to  use  print  unless  another  medium  was 
specifically  justified. 

3)  More  than  40#  of  the  developers  interviewed  Indicated  that  they 
have  had  no  formal  training  in  media  selection  or  developing 
Instruction  for  non-print  media.  Although  not  directly 
addressed  in  the  questionnaire,  it  might  be  reasoned  that 

this  would  h*ve  an  effect  on  the  media  selection  process. 

It  is  likely  that  these  persons  would  choose  print  over 
other  media  due  to  their  familiarity  with  the  development 
and  production  processes  for  this  medium. 

4)  Media  are  often  chosen  on  the  basis  of  convenience  and  time. 
Developers  tend  to  choose  those  processes  that  are  con¬ 
venient  to  them,  and  that  take  the  least  time  to  produce. 

This  is  a  major  reason  why  print  is  often  the  medium 
selected. 

In  summary,  no  consistent  set  of  media  selection  procedures  is  regu¬ 
larly  used  at  the  schools.  In  some  cases  there  Is  a  predetermination  of 
what  media  or  delivery  system  will  be  used  (the  delivery  system  is  chosen 
before  the  individual  objectives  of  the  course  have  been  analyzed  to  find 
out  what  system  would  be  most  suitable).  A  lack  of  training  of  the 
developers,  and  an  existing  model  that  is  perceived  as  being  too  complex, 
often  lead  to  the  selection  of  media  based  on  convenience  and  the  devel¬ 
oper's  intuition  and  experience. 

Current  Problems  in  Selecting  Media 

There  are  many  problems  instructional  developers  working  for  the  Army 
face  when  they  select  media.  Three  of  these  problems  were  identified  in 
the  statement  of  work  for  this  contract;  these  three  problems  are  the 
first  ones  discussed  in  this  section.  The  otner  problems  discussed  in  this 
section  were  consistently  mentioned  by  those  individuals  who  responded  to 
the  interview  questionnaire. 
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a)  Adapting  Instruction  on  the  basis  of  Individual  differences  and 
learner  characteristics 

Over  50%  of  the  developers  Interviewed  at  the  schools  stated  that  they 
did  not  attend  to  "Individual  differences"  per  se.  That  Is,  most  Instruc¬ 
tion  Is  produced  In  only  one  mode  and  aimed  at  the  general  characteristics 

* 

of  the  target  audience.  The  primary  characteristic  that  seemed  to  be  con- 
.  sidered  was  reading  ability.  There  was  almost  unanimous  agreement  that  the 
reading  ability  of  the  soldiers  Is  much  lower  than  it  used  to  be,  and  as  a 
result,  much  of  the  old  material  Is  being  rewritten  at  a  lower  mading 
level.  Audio-visual  materials  are  often  developed  when  It  is  known  that 
the  reading  level  of  the  students  Is  going  to  be  very  low. 

b)  Deciding  between  group-paced  and  self-paced  instruction 

The  decision  to  develop  self-paced  or  group-paced  instruction  is  often 
made  early  in  the  development  process.  This  decision  often  has  a  major 
impact  on  the  media  selection  decisions  that  eventually  follow  it. 

A  group-paced  course  is  generally  taught  by  an  instructor(s).  These 
Instructors  or  their  supervisors  often  have  strong  opinions  on  how  to 
"best"  teach  the  group-paced  courses,  and  therefore  on  what  media  to  use. 
Indeed,  if  the  instructor  Is  not  consulted  when  the  media  selection  deci¬ 
sion  is  made  for  a  group-paced  course,  he  will  often  "override"  that  deci¬ 
sion  when  he  Is  teaching  the  course.  That  is,  the  instructor  will  often 
teach  the  course  using  what  he  considers  to  be  the  most  appropriate  media 
or  medium,  no  matter  what  media  or  medium  was  developed  for  use  in  the 
,  course.  This  problem  often  inhibits  the  developer's  selection  of  media  for 
group-paced  courses. 
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The  self-paced  course  is  usually  "monitored"  by  an  instructor  or 
assistant  instructors  who  deliver  and  supervise  the  use  of  self-paced 
materials.  There  seems  to  be  more  flexibility  in  the  choice  of  media  for 
self-paced  courses  as  the  instructor's  role  is  more  one  of  management, 
evaluation,  and  remediation.  When  the  instructor  does  not  attempt  to  go 
beyond  this  role,  the  self-paced  materials  must  provide  the  learner  with 
practice  and  feedback,  when  the  task  demands  it.  This  limits  the  types  of 
media  that  can  be  used,  especially  when  the  type  of  learner  and  the 
instructional  setting,  as  well  as  the  type  of  task,  are  considered.  Thus, 
it  is  often  difficult  to  select  the  proper  medium  for  self-paced  courses. 
Unfortunately,  whether  or  not  the  developer  selects  the  proper  medium,  his 
decision  is  occasionally  negated  by  instructors  who  attempt  to  restructure 
courses  from  a  self-paced  to  a  group-paced  mode. 

c)  Deciding  when  to  reject  print 

Print  is  often  selected  as  the  instructional  medium  for  a  variety  of 
factors,  including  low  cost,  quick  production  and  revision  time,  and  devel 
oper  familiarity  with  the  medium.  These  factors  often  seem  to  override 
the  issue  of  whether  print  is  the  appropriate  medium  for  a  given  type  of 
learner  and  type  of  learning  task.  Indeed,  less  than  one  half  of  the 
developers  interviewed  indicated  that  they  considered  the  type  of  learning 
involved  when  they  selected  media. 

Thus,  the  problem  seems  to  be  twofold:  first,  many  developers  do  not 
examine  the  factors  in  the  learning  situation  that  might  obviate  the  use 
of  print;  second,  even  if  such  factors  are  considered,  developers  often 
choose  print  instruction  because  it  is  easier  for  them  to  develop,  even  if 
it  might  not  be  the  optimal  medium  for  teaching  a  particular  task. 
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d)  Time  factors 

Over  75%  of  the  group  expressed  concern  over  the  amount  of  time 
allowed  for  materials  development.  Print  was  often  the  medium  chosen 
in  cases  where  time  factors  were  impori^nt.  This  is  one  of  several 
problems  that  involve  constraints  which  decrease  the  probability  that  the 
"best"  medium  will  be  chosen  for  teaching  a  particular  task. 

e)  Cost 

Another  constraint  developers  seem  to  face  in  selecting  the  "best" 
medium  is  cost.  Almost  two-thirds  of  the  developers  indicated  that  cost 
was  a  problem  when  choosing  a  medium.  However,  few  developers  described 
specific  instances  where  cost  was  a  problem.  Thus,  it  might  be  concluded 
that  even  during  the  initial  stages  of  instructional  development,  many 
media  are  not  considered  because  of  perceived  or  real  cost  factors. 

f )  Personnel  problems 

Nearly  two-thirds  (64%)  of  the  interviewees  identified  personnel 
problems  as  a  factor  affecting  media  selection  decisions.  The  personnel 
problems  identified  usually  involved  a  shortage  in  instructional  develop¬ 
ment  staff  and/or  problems  in  getting  instructors  to  accept  changes  in 
instructional  tactics. 

g)  Training  in  media  selection 

Over  50%  of  the  respondents  felt  that  their  lack  of  training  in  media 
selection  was  a  problem.  Several  respondents  also  felt  that  their  super¬ 
visors  needed  training  in  media  selection.  While  a  few  respondents  felt 
that  they  were  able  to  acquire  the  necessary  media  selection  skills  by 
reading  the  ISO  media  selection  procedures,  the  majority  felt  those  proce¬ 
dures  were  too  complex  to  use  without  training. 
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h)  Availability  of  media 

Half  of  the  respondents  felt  that  some  media  were  not  readily 
available  to  them  and  that  this  factor  inhibited  their  efforts  to  select 
appropriate  media.  The  lack  of  availability  of  many  media  can  often  be 
attributed  to  cost  problems  or  administrative  factors  like  lengthy  request 
procedures. 

i )  Suitability  of  the  current  media  selection  guidelines 

While  only  29%  of  the  respondents  indicated  that  the  current  guide¬ 
lines  (ISO)  are  not  suitable  for  use  in  the  media  selection  process,  less 
than  10%  of  the  respondents  actually  use  the  guidelines.  Thus,  it  appears 
that  the  current  guidelines  do  not  aid  many  developers  in  the  media  selec- 
tion  process. 

Analysis  of  the  Media  Selection  Problems 

The  previous  section  of  this  report  described  nine  problems  instruc¬ 
tional  developers  face  when  they  select  media.  All  these  problems  seem  to 
be  real,  and  surely  each  of  them  has  affected  the  way  instructional  devel¬ 
opers  select  media.  However,  if  one  focuses  too  much  attention  on  these 
specific  problems,  one  can  overlook  the  more  basic  problem  that  seems  to 
pervade  the  media  selection  process  in  the  Army.  The  basic  problem  is  that 
1  val id  systematic  means  of  selecting  media  is  rarely  used.  Over  50%  of 
the  respondents  we  questioned  indicated  that  they  do  not  refer  to  any 
guidelines  in  selecting  media.  Another  33%  indicated  that  they  use  the  ISD 
media  selection  guidelines  in  an  informal  manner,  but  could  not  really 
describe  what  that  informal  manner  entailed.  Only  about  10%  of  the  respon¬ 
dents  were  able  to  describe  a  systematic  media  selection  procedure  that 
they  used  and  provide  evidence  that  they  had  used  it. 
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We  believe  that  there  are  basically  two  reasons  why  instructional 
developers  in  the  Army  do  not  use  systematic  media  selection  procedures: 

1)  Either  the  media  selection  decision  is  made  for  the  developer,  of, 

2)  the  developer  feels  more  comfortable  selecting  media  based  on  his 

own  judgment  than  based  upon  a  decision  reached  by  using  some  set 
of  media  selection  guidelines.  '■ 

Media  selection  decisions  are  often  made  before  the  developer  becomes 
involved  in  the  development  process.  Administrative  policy,  influenced  by 
such  factors  as  personnel  availability,  time  constraints,  media  availa¬ 
bility,  and  cost,  often  dictates  the  medium  that  will  be  used.  A 

-77/''-'. 

.  .  V.  M. . 

It  is  likely  that  administrative  policy  will  continue  to  affect  media 

selection  decisions.  At  the  very  least,  however,  developers  should  use 

. 

some  systematic  media  selection  process  to  assess  the  validity  of  the  media 
choices  that  are  made  for  them. 

i 

There  are  several  reasons  why  developers,  when  they  do  select  media, 
usually  do  not  use  systematic  media  selection  procedures.  The  developers 
either: 

o  feel  that  the  current  media  selection  guidelines  (ISD)  are  too 
complex  and  therefore  do  not  use  them; 

o  feel  that  constraints  such  as  time,  money,  and  personnel  limit 
media  options  to  the  extent  that  a  model  is  not  needed  in  order 
to  select  an  appropriate  medium;  or 

o  prefer  to  develop  instruction  using  a  particular  medium,  and 
therefore  usually  choose  that  medium. 

Sometimes  two  or  more  of  the  factors  listed  above  influence  the  developer's 
decision  not  to  .use  a  systematic  media  selection  procedure. 


I 


« 
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Development  of  a  New  Media  Selection  Model 

The  first  of  the  three  factors  listed  above  has  been  addressed 
directly  by  this  project.  Many  (80%)  of  the  developers  interviewed  felt 
that  the  current  guidelines  should  be  revised.  Suggested  revisions 
included: 

-simplify  and  condense  the  present  guidelines; 

-define  terms; 

-limit  the  number  of  learning  categories;  and 

-provide  examples. 

Based  upon  these  suggestions,  the  CET  staff  began  developing  a  new  media 
selection  model . 

Work  on  the  new  media  selection  model  began  in  March,  1980,  after 
members  of  the  CET  staff  had  visited  two  Army  schools  and  had  identified 
the  media  selection  problems  there.  As  work  on  the  model  continued, 
members  of  the  CET  staff  visited  two  other  Army  schools  to  gather  further 
information  about  media  selection  procedures  and  problems.  This  infor¬ 
mation  was  used  by  the  CET  staff  as  they  went  about  designing  the  initial 
version  of  the  new  media  selection  model. 

In  May,  the  initial  version  of  the  new  media  selection  model  and 
several  accompanying  documents  were  completed.  The  model  was  in  flowchart 
form  and  was  accompanied  by  a  set  of  detailed  directions  describing  how  to 
use  the  flowchart,  a  briefer  version  of  those  directions,  and  a  list  of 
media  definitions. 

The  materials  described  above  were  reviewed  by  twelve  instructional 
designers  at  Florida  State  University  who  were  not  directly  involved  in 
the  initial  development  effort.  Eight  of  the  reviewers  were  faculty  mem- 
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bers  and  four  were  graduate  students.  Each  reviewer  examined  the 
materials  independently  and  prepared  a  written  critique. 

After  each  reviewer  submitted  his  or  her  comments,  all  of  the  com¬ 
ments  were  reviewed,  and  numerous  changes  in  the  flowchart  and  accom¬ 
panying  materials  were  decided  upon.  Many  of  the  changes  involved  the 
wording  used  on  the  flowchart  and  in  the  list  of  media  definitions. 

In  addition  to  the  changes  in  wording  that  were  decided  upon,  several 
decisions  were  made  regarding  how  the  materials  would  be  packaged.  For 
example.  It  was  decided  that  the  flowchart  would  be  produced  as  a  job  per¬ 
formance  aid  in  fold-out  form.  It  was  also  decided  that  the  detailed 
directions  and  the  media  definitions  would  be  part  of  a  "User's  Guide," 
which  would  serve  as  a  companion  document  to  the  flowchart. 

While  the  flowchart  and  User's  Guide  were  being  developed,  procedures 
for  formatively  evaluating  those  documents  were  being  planned.  Two  mem¬ 
bers  of  the  CET  staff,  a  faculty  member  and  a  graduate  student,  developed 
the  formative  evaluation  procedures  and  revised  them  based  upon  the  com¬ 
ments  provided  by  another  Florida  State  University  faculty  member,  an 
expert  in  formative  evaluation,  who  reviewed  the  proposed  procedures.  A 
description  of  the  formative  evaluation  procedures  that  were  finally  used 
is  contained  in  Appendix  E.  The  forms  used  during  the  formative  eva¬ 
luation  sessions  are  contained  in  Appendix  F. 

In  September  and  early  October,  after  draft  versions  of  the  flowchart 
and  User's  Guide  were  produced,  both  documents  were  formatively  evaluated, 
using  six  graduate  students  in  the  instructional  design  program  at  Florida 
State  University  as  subjects.  Four  of  the  students  had  previously 
designed  instruction  for  the  military. 
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Based  on  the  formative  evaluation  data  collected  from  the  Florida 
State  students,  several  changes  In  the  flowchart  and  User's  Guide  were 
made.  The  most  Important  change,  made  after  two  of  the  students  had 
served  as  subjects,  was  the  addition  of  a  detailed  example  of  how  to  use 
the  flowchart,  which  was  added  to  the  User's  Guide. 

After  the  flowchart  and  User's  Guide  were  revised  on  the  basis  of  the 
formative  evaluation  data  collected  at  Florida  State  University,  one  of 
the  CE1  faculty  members  visited  Fort  Gordon  to  conduct  further  tryouts. 

Six  Instructional  developers  at  Fort  Gordon  served  as  subjects  In  the  for¬ 
mative  testing,  which  involved  procedures  essentially  the  same  as  those 
employed  afc  Florida  State. 

As  indicated  by  their  responses  to  a  questionnaire  (see  Appendix  G), 
the  developers  at  Fort  Gordon  had  very  positive  attitudes  toward  the  new 
media  selection  model.  However,  based  upon  the  problems  the  developers 
had  when  they  attempted  to  use  the  model,  and  the  comments  they  made  while 
using  it,  several  changes  were  made  both  in  the  flowchart  and  in  the 
User's  Guide.  The  major  change  Involved  rewording  of  one  of  the  questions 
included  in  the  flowchart.  The  question,  which  had  read  "Is  it  a  skill? 
(mental  or  motor),"  was  revised  to  read  "Is  it  an  attitude;  or  verbal 
information?"  Both  questions  were  intended  to  require  the  developer  to 
properly  classify  an  objective  Into  one  of  four  categories  of  learning. 
When  the  former  question  appeared  in  the  flowchart,  however,  many  of  the 
developers  incorrectly  classified  verbal  information  objectives  in  the 
mental  skills  category.  It  was  felt  that  rewording  the  question  as  indi¬ 
cated  above,  and  rewording  the  explanation  that  accompanied  it  would,  alle 
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vlate  this  problem.  Later  tryouts  of  the  model  Indicated  that  the 
problem  was  alleviated  by  making  this  change. 

After  the  model  was  revised  based  on  the  data  collected  at  Fort 
Gordon,  It  was  taken  to  Fort  Rucker,  where  additional  tryouts  of  the  model 
occurred.  The  five  Instructional  developers  at  Fort  Rucker  who  reviewed 
the  model  also  had  positive  attitudes  toward  It  (see  Appendix  H).  While 
the  feedback  these  developers  provided  also  indicated  that  some  changes  In 
the  model  were  necessary,  the  changes  were  few  in  number  and  were  all 
fairly  minor.  The  current  version  of  the  model  incorporates  those 
changes.  A  copy  of  the  model  (flowchart)  can  be  found  inside  the  User's 
Guide. 

The  model  emphasize?  those  instructional  principles,  such  as 
directing  attention  and  providing  feedback,  known  to  affect  human 
learning.  The  manner  in  which  these  principles  should  be  incorporated  in 
an  instructional  sequence  varies  across  different  types  of  learning  tasks, 
and  the  ability  to  incorporate  these  principles  varies  across  media.  The 
model  is  designed  to  enable  instructional  developers  to  identify  those 
media  most  capable  of  properly  incorporating  the  necessary  instructional 
principles  for  teaching  a  given  learning  task.  A  detailed  description  of 
the  theoretical  principles  upon  which  the  model  is  based  is  contained  in 
an  accompanying  technical  report. 

The  model  also  emphasizes  the  importance  of  using  a  systematic  media 
selection  procedure  even  when  the  choice  of  media  is  limited.  Processes 
for  accounting  for  the  constraints  placed  upon  media  selection  decisions 
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are  Included  as  part  of  the  model.  Thus,  the  model  addresses  another  of 
the  problems  typically  faced  by  instructional  developers  when  they  are 
selecting  media. 

Dissemination  of  the  New  Media  Selection  Model 

Although  it  is  felt  that  this  model  addresses  several  of  the  problems 

i 

involved  in  media  selection,  the  model  cannot  solve  those  problems  unless 
instructional  developers  use  it,  and  use  it  properly.  Thus,  if  the  efforts 
devoted  to  this  project  are  to  have  any  effect  upon  the  media  selection 
procedures  employed  in  the  U.S.  Army,  it  is  essential  that  a  dissemination 
plan  be  developed  and  implemented.  This  plan  should  be  designed  to  ensure 
that  the  new  media  selection  model  will  be  used  by  instructional  develop¬ 
ers  in  the  Army  who  are,  or  should  be,  making  media  selection  decisions. 

One  step  in  the  dissemination  plan  would  involve  distributing  the  new 
model.  Since  the  model  has  been  designed  to  be  an  integral  part  of  the 
ISD  process,  it  could  replace,  or  serve  as  alternative  to,  the  current  ISD 
media  selection  guidelines.  TRADOC  might  be  asked  to  issue  it  as  either  a 
replacement  or  a  supplement.  Or,  if  TRADOC  proceeds  with  plans  to  revise 
the  ISD  manuals,  the  new  media  selection  model  could  be  incorporated  into 
the  revision. 

Another  step  in  the  dissemination  plan  would  involve  teaching 
instructional  developers  how  to  use  the  model.  Although  the  new  model  is 
designed  so  that  instructional  developers  can  use  it  just  by  reading  the 
flowchart  and  User's  Guide,  it  might  be  helpful  to  conduct  short  workshops 
designed  to  introduce  the  model  to  developers  and  provide  them  with  prac¬ 
tice  in  using  it. 
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Procedures  similar  to  those  used  during  the  formative  evaluation 
sessions,  perhaps  adapted  for  use  with  small  groups,  might  be  successfully 
employed  during  a  workshop.  Instructional  developers  who  participated  In 
the  evaluation  sessions  became  quite  proficient  In  using  the  model  and 
indicated  a  keen  Interesting  in  using  It  on  the  job. 

Summary  and  Conclusion 

Our  research  has  Indicated  that  Instructional  developers  working  for 
the  U. S.  Army  rarely  use  a  systematic  means  of  selecting  media.  One  of 
the  primary  reasons  they  fall  to  do  so  is  because  they  consider  the 
current  media  selection  model  to  be  too  complex.  The  new  model  we  have 
developed  Is  designed  to  be  less  complex  and  yet  account  for  those 
Instructional  principles  known  to  affect  human  learning. 

The  model  has  gone  through  extensive  formative  testing.  This  testing 
has  helped  to  improve  the  model.  Furthermore,  tho  data  collected  during 
the  testing  has  Indicated  that  the  model  is  easy  to  use  and  is  viewed 
positively  by  most  instructional  developers. 

Whether  instructional  developers  in  the  Army  use  the  model  depends 
largely  upon  whether  the  model  is  properly  disseminated.  If  the  model  is 
disseminated  properly,  it  could  have  a  very  positive  effect  upon  the  media 
selection  procedures  used  in  the  Army. 
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Media  Selection  Interview  Guide 
Background  Information  Sheet 

Name _ _  Military  Rank _ 

Civilian  GS _ _ 

Branch  _ _  '  ■  ■ _  Job  Title _ _ 

Current  Assignment  Date _  Expected  Transfer  Date 

Primary  MOS _ _ _ Duty  MOS _ 

Secondary  MOS _ 

Next  Probable  Joh  Assignment  (If  military) _ 

Do  you  view  Instructional  design  as  a  career? _ 

How  long  have  you  been  designing  Instruction? _ 

Do  you  make  media  selection  decisions?  _  If  so,  how  frequently? 

(circle)  Often  Sometimes  Rarely 

Immediate  Supervisor _ Supervisor  Rank/GS  Level _ 

Briefly  describe  your  job  duties  and  tasks  (list  of  things  you  do).  Please 
Indicate  how  much  of  your  time  Is  spent  performing  each  task  (i.e.,  %  time 
spent). 


1 

I 

1 


% 


Describe  training  in  instructional  design  or  teaching,  if  any  (e.g.,  Mager 
workshop,  ISD  workshop,  college  courses,  Army  instructors  training 
course,  etc.) 


i 
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Media  Availability  and  Selection  Questionnaire 
Listed  below  are  some  of  the  media  you  might  select  to  deliver  Instruction. 
Please  Indicate  whether  each  medium  Is  available  for  you  to  select  and,  If 
so,  how  frequently  you  select  It.  Circle  the  appropriate  responses. 


Media 

Available? 

How  frequently  do  you  select  It? 
(OOften  S«Somet1me$  N-Never) 

L^ve  Instructors 

Print  Materials  (TM,FM) 

Ves  No 

Yes  No 

5“ 

0 

- 5 - - 

s 

- - R 

N 

Programmed  Text 

Yes 

No 

0 

s 

N 

Sllde/Tape  presentations 

Yes 

No 

0 

s 

N 

Filmstrips  with  audio 

Yes 

No 

0 

s 

N 

Slides  or  Filmstrips 
without  audio 

Yes 

No 

0 

s 

N 

Microforms 
(Flche,  Film,  etc.) 

Yes 

No 

0 

s 

N 

Motion  Pictures 

Yes 

No 

0 

s 

N 

Overhead  Transparencies 
(Vlewgraphs) 

Yes 

No 

0 

s 

N 

Opaque  Projector 

Yes 

No 

0 

s 

N 

TV  Cassette 

Yes 

No 

0 

s 

N 

Broadcast  Television 

Yes 

No 

0 

s 

N 

Programmed  TV  (Videodisc) 

Yes 

No 

0 

s 

N 

Audio  Tapes 

Yes 

No 

0 

s 

N 

Broadcast  Radio 

Yes 

No 

0 

s 

N 

Computers 

Yes 

No 

0 

s 

N 

Study  Cards 

Yes 

No 

0 

s 

N 

Games 

Yes 

No 

0 

s 

N 

Charts  and  Graphs 

Yes 

No 

0 

s 

N 

Operational  Equipment 

Yes 

No 

0 

s 

N 

Models  and  Mock-ups 

Yes 

No 

0 

s 

N 

Component  Objects  (part  of 
a  real  equipment  system) 

Yes 

No 

0 

s 

N 

Procedure  Trainers 

Yes 

No 

0 

s 

N 

Simulators 

Yes 

No 

0 

s 

N 

Others  (please  list) 

Yes 

No 

0 

s 

N 

Yes 

No 

0 

s 

N 
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Learning  Categories  Questionnaire 

1.  In  arriving  at  media  selection  decisions,  do  you  classify  learning  Into 

specific  types  or  categories?  _ 

2.  If  your  answer  to  question  1  was  "yes,"  please  Indicate  which,  If  any, 
of  the  following  categories  you  use.  For  those  categories  you  do  use, 
please  Indicate  the  frequency  of  use.  Circle  the  appropriate  responses. 

How  Frequently  Do  You  Use  It? 

Category  Do  You  Use  It?  (0»0ften  S«Somet1mes  R»Rarely) 


Rule  Learning  and  Using 

Yes 

No 

0 

s 

R 

Classifying -Recogn 1 2 1 ng 
Patterns 

Yes 

No 

0 

s 

R 

Identifying  symbols 

Yes 

No 

0 

s 

R 

Detecting 

Yes 

No 

0 

s 

R 

Making  Decisions 

Yes 

No 

0 

s 

R 

Recalling  Bodies  of 
Knowledge 

Yes 

No 

0 

s 

R 

Performing  Gross  Motor 
Skills 

Yes 

No 

0 

s 

R 

Steering  and  Guiding  - 
Continuous  Movement 

Yes 

No 

0 

s 

R 

Positioning  Movement  and 
Recalling  Procedures 

Yes 

No 

0 

s 

R 

Voice  Communicating 

Yes 

No 

0 

s 

R 

Attitude  Learning 

Yes 

No 

0 

s 

R 

3.  If  you  use  categories  other  than  those  listed  above,  please  Indicate 
the  categories  you  use  and  how  frequently  you  use  them. 

Frequency  of  Use 

Category  (0a0ften  SsSomet1mes  RgRarely) 

OS  R 


OS  R 


0 


S 


R 


Interview  Questionnaire 


Interv1ewee_ 

Interviewer 


Part  I;  Instructional  Development  and  Media  Selection  Procedures  Followed 
General  question: 

A.  How  do  you  go  about  developing  instruction? 


v> 


22 


B.  How  do  you  select  media  to  deliver  instruction? 


pecific  Questions: 

1.  When  are  media  selected? 

2.  What  percentage  of  your  time  is  spent  selecting  media? 

3.  What  selection  process  or  strategy  do  you  use? 

4.  Do  you  consider: 

(a)  learning  categories? 

(b)  learner  interaction? 

(c)  costs? 

(d)  individual  differences? 

(e)  instructional  setting? 

5.  Who  reviews  and  approves  your  selection  decisions? 


6.  What  percentage  of  your  decisions  are  approved? 


Part  II:  Guidelines  Used 


General  Questions: 

A.  What  written  guidelines  for  the  selection  of  media  do  you  use 
regular iy?  How  do  you  use  them? 


B.  What  training  did  you  receive  on  the  use  of  guidelines? 
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C.  Are  you  familiar  with  the  ISD  model  for  media  selection?  Do  you  use 
It?  Why?  Why  not? 


Specific  Questions: 

1.  Do  you  find  the  ISD  learning  sub-categories  useful?  (Show  the  Learning 
Categories  Questionnaire.)  Why?  Do  you  use  them  to  help  you  make 
media  selection  decisions? 


2.  Do  you  use  the  Learning  Objective  Analysis  Worksheet?  Why?  (Show  a 
LOAW. ) 


3.  Do  you  consider  the  ISD  learning  sub-category  matrices  useful?  (Show 
sample  matrix.) 


4.  Do  you  think  the  media  rejection  factors  listed  in  the  ISD  Model  are 
useful?  (Show  copy  of  pp.  120-121,  Phase  III.) 


5.  Do  you  usually  prepare  a  rationale  for  the  media  selection  decisions 
you  make?  Do  you  think  that  preparing  a  rationale  is  a  worthwhile 
activity?  Why? 


26 


Part  III:  Constraints  Faced 
General  Questions: 

A.  What  constraints  or  problems  do  you  face  In  selecting  media? 

Specific  Questions: 

Which  ot'  the  following  are  problems  for  you? 

1.  Suitability  of  current  media  selection  guidelines? 

2.  Training  in  media  selection? 

3.  Availability  of  particular  media? 

4.  Supervisor  preferences  of  media? 

5.  Time  factors? 

6.  Cost,  budget? 

7.  Personnel? 

8.  Equipment  and  materials? 

9.  Facilities  for  delivering  instruction? 

10.  Other?  (Include,  as  appropriate,  factors  described  by  other  personnel 
interviewed. ) 
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Part  IV:  Solutions  Suggested 
General  question: 

A.  What  do  you  see  as  possible  solutions  to  the  media  selection  problems 
you  face? 

Specific  Questions: 

1.  What  would  help  you  eliminate  the  constraints  or  problems  you  have  s 
identified? 

2.  Would  training  in  the  use  of  the  current  guidelines  be  helpful? 

3.  Should  current  guidelines  be  revised?  How? 

4.  Should  new  media  selection  guidelines  be  developed? 

5.  How  should  the  new  guidelines  be  structured? 

a)  flowchart? 

(b)  matrix? 

(c)  job  performance  aid?  What  do  you  mean  by  job  performance  aid? 

Can  we  see  an  example? 

(d)  other? 


6.  Is  it  likely  that  you  would  use  new  guidelines?  Why? 


7.  Other?  (Include,  as  appropriate,  factors  described  by  other  personnel 
interviewed. ) 


28 


.  '  .  'Appendix  C 

f 

Summary  of  the  Responses  to  the  General  Information  Questionnaire 


Summary  of  Responses  to  the  General  Information  Questionnaire 

I.  Composite  view  of  media  availability  and  selection  at  the  four  Army 

schools  visited 

A.  Number  of  Respondents  a  49  (Several  respondents  failed  to  respond 

to  all  of  the  questions) 

B.  Availability 

1.  The  media  most  available  were  print  material  (43),  slide/tape 
(43),  operational  equipment  (41),  programed  text  (40),  audio 
tapes  (40),  charts/graphs  (40),  and  models/mock-up?  (40). 

Notes :  a)  The  "video  tape"  category  only  appeared  on  the 
Gordon  questionnaire.  Nineteen  (100%)  of  the 
respondents  said  that  it  was  available.  If  this 
information  were  pooled  with  the  TV  cassette  data 
from  the  other  questionnaires,  then  44  respondents 
would  indicate  that  TV  tapes/cassettes  are 
available. 

b)  The  Gordon  questionnaire  only  had  the  category  of 
"filmstrip"  as  opposed  to  the  two  categories  of 
more  recent  questionnaires  which  were  "filmstrips 
with  audio"  and  "filmstrips  without  audio."  For 
;  purposes  of  tabulation  and  this  discussion,  the 

Gordon  "filmstrip"  data  was  subsumed  into  the  cate¬ 
gory  of  "filmstrips  without  audio."  Thirteen  out 
of  a  possible  nineteen  Gordon  respondents  said 
filmstrips  were  available. 

2.  The  media  least  available  were  broadcast  radio  (6),  programmed 
TV  (13),  microforms  (13),  opaque  projector  (15),  and  computers 
(17). 

3.  With  the  exceptions  of  radio  (12%),  all  of  the  media  were  indi¬ 
cated  as  being  available  by  at  least  25%  of  the  respondents. 

C.  Frequency  of  Selections 

1.  Those  materials  receiving  most  responses  in  the  "often"  cate¬ 
gory  were  operational  equipment  (30)  and  print  material  (29). 

2.  Those  materials  receiving  most  responses  in  the  combination  of 
both  "often"  and  "sometimes"  categories  were  print  materials 
"(157,  operational  equipment  (39),  and  models/mock-ups  (38). 
Also,  if  video  tapes  and  TV  cassettes  data  were  pooled,  the 
combined  category  would  be  included  here  with  39  respondents. 

Note:  For  more  detailed  information,  see  item  #3  on  the  next 
page. 


3.  Below  is  a  table  showing  the  frequency  of  responses  for 
often/sometimes  categories. 


Print  Materials 
Operational  Equipment 
Video  Tapes  +  Cassettes 
Models/Mock-ups 
Charts/Graphs 
Slide/Tape 
Programed  Text 
Live  Instruction 
Audio  Tapes 

Overhead  Transparencies 

4.  Those  media  selected  least  often/sometimes  were  radio  (2), 
microforms  (4),  opaque  projector  (6),  programmed  TV  (7),  and 
games  (8). 

II.  Composite  view  of  learning  categories  used  at  the  four  Army  schools 
visited 

A.  Answers  to  the  question  "do  you  classify  learning  into  specific 
types  or  categories?" 

Number  of  "yes"  respondents  3  36  ' 

Number  of  "no"  respondents  *  7  • 

Number  of  respondents  not  answering  3  6 

Total  3  49 

B.  Statements  summarized  from  43  respondents 

1.  All  II  types  of  learning  listed  on  the  questionnaire  were 
selected  either  "often"  or  "sometimes"  by  at  least  14 
respondents.  Below  are  listed  those  types  having  the  greatest 
number  of  responses  in  the  combined  "often/sometimes"  categories. 


Identify  Symbols  29 
Making  Decisions  28 
Rule  Learning  27 
Classifying  25 
Recalling  Knowledge  24 
Voice  Communicating  24 


2.  The  categories  receiving  the  least  number  of  responses  in  the 
combined  "often"  and  "sometimes'1  categories  were  steering/ 
guiding  (14)  and  detecting  (17). 


Often 

~W~ 

Sometimes 

— n- 

Often/Sometimes 

30 

9 

39 

6+11-17 

10+12-22 

17+22-39 

9 

29 

38 

14 

23 

37 

16 

21 

37 

14 

23 

37 

19 

15 

34 

4 

29 

33 

11 

20 

31 

31 


III.  Tabulation  of  responses  to  the  Media  Availability  +  Selection 
Questionnaire 


Media 


Available? 
Yes  No 


How  frequently  do  you  select  It? 
(0«0ften  S-Sometlmes  N»Never) 


live  Instructors 

35 

3 

19 

15 

0 

Print  Materials  (TM,FM) 

43 

0 

29 

11 

2 

Programed  Text 

40 

0 

14 

23 

3 

Slide/Tape  presentation 

43 

0 

16 

21 

5 

Filmstrips  with  audio 

18 

0 

7 

8 

3 

Slides  or  Filmstrips 

33 

5 

7 

20 

5 

without  audio 

Microforms 

13 

11 

0 

4 

Q 

(Flche,  film,  etc.) 

Motion  Pictures 

37 

2 

5 

24 

8 

Overhead  Transparencies 

39 

2 

11 

20 

7 

(Viewgraphs) 

Opaque  Projector 

15 

2 

1 

3 

8 

TV  Cassettte 

25 

0 

11 

12 

0 

Broadcast  Television 

23 

5 

6 

8 

9 

Programmed  TV  (Videodisc) 

13 

1 

3 

4 

5 

Audio  Tapes 

40 

1 

4 

29 

5 

Broadcast  Radio 

6 

15 

1 

1 

4 

Computers 

17 

7 

0 

13 

4 

Study  Cards 

24 

7 

2 

11 

11 

Games 

19 

10 

0 

8 

11 

Charts  and  Graphs 

40 

0 

14 

23 

3 

Operational  Equipment 

41 

0 

30 

9 

0 

Models  and  Mock-ups 

40 

0 

9 

29 

1 

(Continued) 


Media 


Available?  How  frequently  do  you  select  It? 
Yes  No  (O-Often  $ ■Sometimes  iWlever) 


Component  Objects  (part  of 
a  real  equipment  system) 

19 

0 

S 

14 

0 

Procedure  Trainers 

29 

3 

6 

22 

1 

Simulators 

33 

1 

8 

22 

3 

Video  Tapes 

19 

0 

6 

10 

3 

Other  media  listed:  JPA,  Non-Instructlonal  Texts,  Correspondence  Courses 

Language  Labs. 
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IV.  Tabulation  of  responses  to  the  Learning  Categories  questionnaire 


Learning  Category 


Do  You  Use  It?  How  Frequently  Do  You  Use  It? 
— -Yes  No  (0*0ften  S»Somet1mes  R»Rarelv 


Rule  Learning  and  Using 

29 

14 

14 

13 

2 

C 1  ass 1 f y 1 ng-Recogn 1  z  1  ng 
Patterns 

26 

17 

10 

15 

1 

Identifying  Symbols 

29 

14 

14 

15 

0 

Detecting 

18 

25 

11 

6 

1 

Making  Decisions 

30 

13 

16 

12 

2 

Recalling  Bodies  of 
Knowledge 

26 

17 

12 

12 

2 

Performing  Gross  Motor 
Skills 

29 

14 

13 

13 

3 

Steering  and  Guiding  - 
Continuous  Movement 

16 

27 

5 

9 

2 

Positioning  Movement  and 
Recalling  Procedures 

24 

19 

11 

9 

4 

Voice  Corrmunl eating 

25 

18 

14 

10 

1 

Attitude  Learning 

22 

21 

10 

11 

1 

Other  categories  listed:  Judging  proficiency,  recall  of  procedures  and  logic, 

trouble-shooting  requiring  motor  skills,  and 
discrimination. 


•  -t 
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Summary  of  the  Responses  to  the  Interview  Questionnaire* 


*Th1s  summary  was  prepared  by  Janet  L.  Winner 
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Summary  of  Responses  to  the  Interview  Questionnaire 
The  following  description  represents  a  summary  of  the  input  received 
from  instructional  development  personnel  at  the  four  Army  schools  visited 
as  part  of  this  contract  (Forts  Bel  voir,  Devens,  Gordon,  and  Rucker).  The 
input  was  obtained  by  asking  these  personnel  to  respond  to  a  interview 
questionnaire  developed  for  the  contract.  The  respondents  to  the  question¬ 
naire  were  both  military  (N=6)  and  civilian  (N=23)  employees  and  had  been 
selected  from  a  larger  group  (49  Individuals)  than  designated  by  DTO 
branch  chiefs  as  having  involvement  in  the  media  selection  process.  The 
questionnaire  was  administered  during  March  and  April,  1980  by  staff  mem¬ 
bers  of  the  Center  for  Educational  Technology  (CET).  Responses  are  sum¬ 
marized  by  question.  The  numbers  in  parentheses  following  each  question 
indicate  the  number  of  individuals  responding  to  that  question. 

I.  Instructional  Development  and  Media  Selection  Procedures  Followed 
'  How  do  you  go  about  developing  instruction?  (N=19) 

All  of  the  people  responding  to  this  question  indicated  that  they 
used  some  sort  of  systematic  instructional  development  procedure  to 
design  instructional  materials.  Over  one-quarter  (26%)  of  these 
respondents  replied  that  they  followed,  to  some  degree,  ISD  procedures 
in  their  development  process.  Another  third  of  the  group  (37%)  devel¬ 
oped  instruction  using  procedures  similar  to  ISD,  although  such  proce¬ 
dures  were  not  described.  While  other  respondents  did  not  acknowledge 
using  ISD,  or  a  variation  thereof,  their  answers  appear  to  suggest  that 
some  systematic  approach  is  taken  in  the  process  of  developing 
instruction. 


*  I 
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Each  of  the  following  development  procedures  was  mentiomd  at 
least  once  in  response  to  this  question: 

1.  -  identify  and  obtain  critical  task  list(s) 

2.  -  generate  objectives  (sometimes  they  are  classified  according 

to  learning  categories) 

3.  -  develop  tests 

4.  -  develop  instruction 

5.  -  field  test  or  validate  instruction. 

No  single  respondent  gave  this  complete  list  of  procedures  as  his  par¬ 
ticular  development  process.  However,  it  seems  that  course  development 
is  generally  approached  in  a  fairly  systematic  manner. 

Mow  do  you  select  media  to  deliver  instruction?  (N=20) 

In  response  to  this  question,  20%  of  the  respondents  believe  that 
the  selection  of  media  is  usually  determined  prior  to  the  development 
effort.  About  one  third  of  those  responding  indicated  that  they  were 
infuenced  by  ISD  in  selecting  a  medium  for  instruction,  though  they  did 
not  strictly  adhere  to  the  ISD  guidelines.  Another  20%  of  the  respon¬ 
dents  replied  that  they  tried  to  ascertain  the  nature  of  the  task, 
i.e.,  whether  it  required  memorization,  hands-on  experience, 
visualization,  or  motion.  The  medium  selected  was  then  based  on  the 
type  of  task  or  skill  to  be  trained. 

When  choosing  media,  20%  of  the  respondents  considered  comments 
or  recommendations  offered  by  the  instructors.  Cost,  in  terms  of 
availability  of  media,  was  viewed  as  a  factor  in  media  selection  by  10% 
of  the  developers. 
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When  are  media  selected?  (N=13) 

The  responses  of  over  two-thirds  of  the  developers  interviewed 
indicated  that  media  were  selected  after  the  specification  of 
objectives,  tests  and  learning  activities.  The  remaining  responses  to 
this  question  suggest  that  the  media  are  chosen  before  the  developer 
becomes  involved  in  the  development  process. 

What  percentage  of  your  time  is  spent  selecting  media?  (N=12) 

The  majority  (83%)  of  developers  said  they  spent  less  than  5%  of 
their  time  in  the  selection  process.  In  two  instances,  developers 
stated  they  spent  between  15  -  25%  of  their  time  in  selecting  media; 
however,  such  an  inordinate  amount  of  time  suggests  that  a  unique 
training  situation  may  have  been  present. 

What  selection  process  or  strategy  do  you  use?  (N=9) 

One-third  of  the  respondents  replied  that  the  instructional 
setting  dictated  the  media  selection  process.  Other  responses  were 
assorted  and  included: 

-  use  print  unless  it  is  shown  to  be  ineffective; 

-  if  content  is  recognition  type,  use  slides; 

-  consider  type  of  equipment,  motivation  and  existing  materials; 

-  do  what  "feels"  like  the  best  thing. 

Do  you  consider  the  following  when  selecting  media? 

Learning  categories?  (N=21).  Slightly  less  than  one-half  (43%) 
of  the  respondents  addressed  the  learning  category  of  the  subject 
matter  content  in  their  design  of  instruction.  Within  this  group,  a 
particular  note  was  made  of  the  importance  of  vititudes  in  media 
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selection.  An  equal  number  of  people  responding  to  this  question  did 
not  consider  learning  categories. 

Learner  Interaction?  ( N«10) .  Seven  of  the  ten  respondents 
acknowledged  that  they  considered  learner  interaction  In  their  design 
process, ^however,  this  was  never  operationally  defined.-  The  remaining 
30%  of  the  developers  did  not  address  learner  interaction. 

Costs?  (N=25).  Sixty  percent  of  the  developers  questioned  felt 
that  costs  were  a  major  restriction  in  developing  training.  It  was 
not  clear  what  these  costs  included,  e.g.,  personnel,  equipment, 
media,  etc.  The  remaining  40%  of  the  interviewees  did  not  believe 
cost  factors  were  important  considerations  in  selecting  media. 

Individual  differences?  (N=13).  Over  half  of  the  developers 
designed  instruction  to  a  particular  audience  and  not  to  individual 
differences.  Most  of  them  said  that  reading  level  was  an  important 
factor  to  consider,  and  when  designing  instruction  for  poor  readers, 
they  primarily  used  audio-visual  materials. 

Instructional  setting?  (N=17).  One-third  of  the  developers 
agreed  that  instructional  setting  was  considered  in  selecting  media. 
The  setting  was  thought  to  be  important  by  some  developers  because  it 
influenced  accessibility  of  hands-on  equipment  and  availability  of 
electricity.  For  still  other  respondents,  the  use  of  the  instruction 
in  a  non-resident  site  meant  the  medium  selected  was  usually  print. 


Nearly  one-half  (48X)  of  the  respondents  replied  that  their  selec¬ 
tion  decisions  were  not  reviewed.  Approximately  20X  of  the  developers 
said  that  their  supervisors  "checked"  the  selection  decisions,  however 
this  checking  process  was  not  described. 

What  percentage  of  your  decisions  are  approved?  (N=19) 

- Nearly  half  of  the  developers  did  not  feel  their  decisions  were 


either  approved  or  disapproved,  rather  such  decisions  were  agreed  upon, 
taking  Into  account  available  resources. 
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II.  Guidelines  Used 

What  written  guidelines  for  the  selection  of  media  do  you  use 
regularly?  How  do  you  use  them?  (N=24) 

It  does  not  appear  as  though  a  standard  set  of  guidelines  is 
widely  used  across  schools.  While  it  is  evident  that  guldel ines_are 
available,  it  seems  as  though  the  developers  have  identified  their  own 
functional  strategies  for  media  selection.  One-third  of  the  developers 
used  at  least  a  part  of  the  ISD  guidelines  when  selecting  media.  Over 
one-half  of  the  group  did  not  refer  to  any  guidelines.  Two  other 
approaches  mentioned  and  used  were  guidelines  from  the  University  of 
Wisconsin  and  Catholic  University. 

What  training  did  you  receive  on  the  use  of  guidelines?  (N=28) 

From  the  preceding  question  it  is  clear  that  few  of  the  devel¬ 
opers  actually  utilize  media  selection  guidelines.  It  is  interesting 
to  note  that,  with  respect  to  this  question,  43%  of  the  developers 
replied  that  they  had  not  received  any  training  in  the  use  of  guide¬ 
lines  for  media  selection.  At  this  point  one  might  wonder  if  there  is 
a  causal  relationship  operating  here.  Other  responses  about  training 
included:  the  ISD  workshops  (21%);  on-the-job  training  (18%;.*  and  the 
CRI  Workshop  (14%). 

Are  you  familiar  with  the  ISD  model  for  media  selection?  Do  .you  use 
it?  Why?  Why  not?  (N=26) 

Over  two-thirds  of  the  developers  interviewed  were  familiar  with 
the  ISD  approach  to  media  selection.  Of  these,  most  do  not  regularly 
use  the  selection  criteria,  though  portions  of  the  ISD  criteria  list 
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may  be  considered.  The  media  selection  model  Is  not  used  either 
because  It  Is  too  complex  or  there  Is  no  opportunity  to  apply  It. 

Do  you  find  the  ISP  learning  subcateciories  useful?  Why?  Do  you  use 
them  to  help  you  make  media  selection  decisions?  (Na23) 

Nearly  everyone  responding  to  this  question  agreed  that  the  sub¬ 
categories  were  useful,  In  varying  degrees.  Comments  about  the  sub¬ 
categories  Indicated  that  they  could  be  condensed  since  not  all  eleven 
of  them  were  used  regularly.  Also,  some  subcategories  are  difficult  to 
understand.  While  most  developers  agreed  with  the  utility  of  such 
learning  categories,  few  actually  use  all  of  them  in  designing 
instruction. 

Do  .you  use  the  Learning  Objective  Analysis  Worksheet  ( LOAW) ?  Why? 
(N-21) 

Over  70%  of  the  respondents  acknowledged  that  they  used  a  revised 
version  of  the  LOAW.  The  remaining  developers  either  did  not  find  the 
LOAW  applicable  to  their  situation  or  received  the  preliminary  infor¬ 
mation  in  another  form  from  Training  Analysis. 

Do  you  cons  :r  the  ISP  learning  subcategory  matrices  for  media  selec¬ 
tion  useful?  (N=26) 

Nearly  every  interviewee  (96%)  believed  the  ISD  matrices  were  too 


complicated  or  too  unwieldy  to  be  of  practical  value  when  designing 
instruction.  When  used,  the  matrices  primarily  verified  decisions 
already  made. 
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Do  you  think  the  media  rejection  factors  listed  In  the  ISP  model  are 
useful?  (N*22) 

The  vast  majority  (95%)  of  the  respondents  did  not  consciously  use 
the  rejection  factors  and,  therefore,  replied  that  such  factors  were 
not  useful  in  their  decision-making. 

Do  you  usually  prepare  a  rationale  for  the  media  selection  decisions 
you  make?  Do  you  think  that  preparing  a  rationale  is  a  worthwhile 
activity?  Why?  (N=24) 

Most  developers  (6730  did  not  feel  it  was  necessary  to  generate  a 
rationale. 

III.  Constraints 

What  constraints  or  problems  do  you  face  in  selecting  media?  (N=3) 

Within  this  portion  of  the  questionnaire  many  specific  questions 
related  to  constraints  were  asked.  The  general  comments  on  this  topic 
included  the  observation  that  the  reading  level  of  the  trainee  was  a 
problem  in  deciding  on  the  media.  Also,  TRADOC  requires  a  specified 
number  of  videotapes  to  be  produced  each  year,  which  automatically 
"selects"  the  medium  for  some  of  the  instructor 
Suitability  of  current  media  selection  guidelines?  ( N=21 ) 

Most  respondents  (7150  did  not  feel  that  current  guidelines  were  a 
problem;  however,  it  may  be  inferred  from  the  responses  that  this 
question  was  not  applicable  to  many  developers  because  most  of 
them  did  not  follow  the  ISO  media  selection  guidelines. 

Training  in  media  selection?  (N=23) 

Over  one-half  of  the  respondents  felt  that  some  type  of  training 
would  be  helpful.  Such  training  may  take  the  form  of  a  "How-to... 
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manual  for  media  selection  or  additional  training  for  new  employees  or 
TEC  branch  people.  The  remaining  developers  (43%)  felt  that  training 
was  not  a  problem  in  the  media  selection  process. 

Availability  of  particular  media?  (N=24) 

Half  of  the  people  responding  to  this  question  agreed  that  availa¬ 
bility  was  a  problem;  half  disagreed.  Availability  problems  included: 
the  restricted  selection  of  media  for  TEC,  the  tedious  approval  process 
in  using  job  performance  aids,  the  difficulty  in  obtaining  videotape 
recorders,  and  the  prohibitive  cost  of  acquiring  real  equipment  for 
training  purposes. 

Supervisor  preferences  of  media?  (N=26) 

Two-thirds  of  the  respondents  did  not  believe  that  their 
supervisor's  preferences  for  media  were  problematic.  Several  of  the 
remaining  one-third  stated  that  TRADOC  wanted  print,  while  TEC  called 
for  audio-visual  instruction. 

Time  factors?  (N=25) 

Over  three-fourths  of  the  group  interviewed  expressed  concern  over 
the  issue  of  time.  Lecture  and  print  were  the  media  chosen  in  cases 
where  the  time  factors  were  important.  Print,  in  particular,  was  often 
chosen  because  it  requires  less  time  to  develop  and  can  be  mass  pro¬ 
duced  quickly  (as  opposed  to  slides  or  videotape,  for  example). 

Cost,  budget?  (N=22) 

Nearly  two-thirds  (64%)  of  the  developers  responded  that  cost  was 
a  problematic  factor,  although  few  developers  described  specific 
instances  where  cost  was  a  problem. 
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Personnel?  (N=23) 

Nearly  two-thirds  of  the  interviewees  identified  personnel 
problems  as  a  factor  affecting  media  selection  decisions.  Problems 
with  personnel  were  of  an  assorted  nature  and  included: 

-  cut-backs  without  replacements; 

-  instructors  resisting  change; 

-  military  transfer  of  trained  staff; 

-  insufficient  manpower. 

Equipment  and  Materials?  (N=25) 

Only  one-third  of  the  developers  identified  equipment  and 
materials  as  problems.  The  chief  cause  of  the  problem  seemed  to  be 
either  lack  of  availability  or  poor  maintenance  for  both  real  equipment 
and  media  hardware. 

Facilities  for  delivering  instruction?  (N=25) 

The  majority  (88%)  of  the  developers  did  not  have  problems  with 
the  facilities.  The  only  concern  voiced  about  facilities  was  the 
accessibility  of  electricity  for  mediated  instruction  delivered  in  the 
field. 

IV.  Solutions  Suggested 

What  do  you  see  as  possible  solutions  to  the  media  selection  problems 
you  face?  (N=7) 

The  solutions  which  developers  suggested  were  fairly  predictable, 
given  the  responses  to  specific  constraints  faced.  The  same  solutions 
were  offered  by  several  repondents  and  included  availability  of  and 
accessibility  to  the  following: 
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-  more  money; 

-  more  time; 

-  more  training; 

-  more  people. 

One  individual  replied  that  TEC  should  allow  for  more  media 
choices. 

What  would  help  .you  eliminate  the  constraints  or  problems  you  have 
identified?  (N=4) 

Again,  the  responses  to  this  specific  question  were  very  similar 
to  the  preceding  suggestions.  Specific  answers  included:  training 
personnel,  stabilizing  the  turnover  situation,  and  providing  additional 
money. 

Would  training  in  the  use  of  current  guidelines  be  helpful?  (N=18) 
While  it  was  not  necessarily  felt  that  training  was  needed  in  use 
of  the  current  guidelines,  61%  of  the  developers  responding  agreed  that 
training  in  media  selection  would  be  helpful.  A  suggestion  was  made 
that  this  training  should  address  the  attitudes  of  designers  and  admin¬ 
istrators  toward  media  selection. 

Should  current  guidelines  be  revised?  How?  (N=25) 

Eighty  percent  of  the  interviewees  supported  the  idea  of  revising 
the  guidelines.  Comments  substantiating  the  value  of  revisions 
included: 

-  simplify  and  condense  present  guidelines; 

-  define  terms; 

-  make  ISO  more  specific; 
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-  cut  down  on  the  learning  categories;  and 

-  provide  more  examples. 

Onei  respondent  observed  that  the  guidelines  currently  include  a  lot  of 
"what  to  do"  hut  not  much  "how  to  do  it." 

Should  new  media  selection  guidelines  be  developed?  (N=18) 

Over  one-half  of  the  developers  who  responded  to  this  question 
agreed  that  new  guidelines  should  be  developed,  provided  they  were 
simpler  than  existing  guidelines. 

How  should  new  guidelines  be  structured? 

Flowchart?  (N=18) 

Over  70%  of  those  who  commented  on  this  option  felt  that  a 
flowchart  approach  would  be  useful  if  it  included  examples  of  how  to 
work  through  the  components  of  the  flowcharts. 

Matrix?  (N=18) 

Nearly  two-thirds  of  those  responding  supported  the  use  of  a 
matrix  if  it  were  simpler  than  the  ISD  matrix  and  if  it  included 
explanations. 

Job  performance  aids,  ( OPAs )?  (N=19) 

The  majority  (84%)  of  developers  responded  favorably  to  the  use 
of  a  JPA.  Most  of  the  developers  defined  JPAs  as  step-by-step  proce¬ 
dural  guides  that  could  appear  in  list  or  flowchart  form. 

Is  it  likely  that  you  would  use  new  guidelines?  Why?  (N*26) 

Over  one-half  of  the  respondents  indicated  they  would  use  new 
guidelines,  especially  if  such  guidelines  responded  to  a  need. 
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Summary 

Twenty-nine  military  and  civilian  Instructional  developers  were 
Interviewed  by  CET  staff  members  during  March  and  April,  1980.  The 
developers  had  been  selected  based  on  their  Involvement  in  the  media 
selection  process.  As  a  result  of  the  interviews,  It  was  apparent 
that  in  the  vast  majority  of  instances,  media  appeared  to  be  selected 
without  the  use  of  guidelines. 

The  media  selection  technique  described  in  ISD  is  considered  by 
most  developers  as  too  complicated  to  be  of  value  on  a  regular  basis. 
Much  of  the  ISD  media  selection  information  is  not  especially  useful 
to  the  developers  interviewed.  Problems  faced  in  selecting  media  were 
primarily:  not  enough  money;  too  little  time;  too  few  people;  and 
insufficient  training.  Nearly  one-half  of  the  respondents  had 
received  no  formal  training  in  media  selection  procedures.  With 
respect  to  training,  the  consensus  of  opinion  seemed  to  be  that  training 
should  be  concerned  with  media  selection  procedures  and  should  address 
the  attitudes  of  developers  and  administrators  toward  media  selection. 

The  majority  of  developers  felt  the  current  media  selection  guide¬ 
lines  should  be  revised.  They  felt  the  revised  version  should  be 
simplified  and  perhaps  appear  as  a  JPA  in  either  list  or  flowchart 
form. 
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Media  Selection  Model 
Formative  Evaluation  Procedures* 

General  Directions 

1.  The  purpose  of  formative  evaluation  is  to  gather  data  to  be  used  in 
revising  the  product.  Therefore,  in  general,  record  only  those  things  which 
will  have  some  bearing  on  revisions  we  will  make  in  the  model. 

2.  When  participants  ask  questions  about  parts  of  the  model,  don't  answer  them 

■  f  ' 

directly  without  first  making  sure  you  have  understood  and  recorded  the  real 
problem. 

3.  Ask  questions  at  all  points  the  participant  diverges  from  the  ideal  path  we 
have  defined  for  an  objective. 

4.  The  following  materials  will  be  needed: 

a.  two  copies  of  the  flowchart, 

b.  two  copies  of  the  "User's  Guide," 

c.  copies  of  the  Media  Selection  worksheet, 

d.  these  directions, 

e.  several  copies  of  the  observation  form, 

f.  the  attitude  questionnaire, 

g.  the  objectives  we  developed  for  use  in  evaluating  the  model, 

h.  the  formative  evaluation  JPA, 

i.  a  pencil  or  pen, 

j.  a  watch. 

*N0TE:  The  procedures  listed  here  are  presented  in  the  form  of  directions. 

These  directions  were  given  to  those  CET  staff  members  who  con¬ 
ducted  the  formative  evaluation  sessions. 
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Procedure 

1.  Before  the  participant  arrives,  record  your  name,  his  or  her  name,  and  the 
number  of  each  objective  to  be  used  at  the  top  of  copies  of  the  observation  form. 
Label  one  "Directions"  and  one  "Example."  Have  a  supply  of  blank  forms  close  at 
hand. 

2.  Explain  the  participant's  role  to  him.  Say  that  we  are  developing  an 
alternative  media  selection  model  for  the  ISD  process,  and  that  his  or  her  com¬ 
ments  will  be  used  to  help  revise  the  current  draft. 

3.  Begin  with  the  form  you  labelled  "Directions."  Record  the  starting  time. 

4.  Have  the  participant  read  the  general  directions  titled  "What  You  Will 
Need"  and  "How  to  Proceed."  Tell  the  participant  to  comment  when  anything  is 
unclear.  List  comments  on  the  observation  form,  recording  the  number  of  the 
direction  the  comments  refer  to. 

5.  When  the  participant  finishes  with  the  directions,  record  the  time  at  the 
bottom  of  the  form  you  are  on  and  at  the  top  of  the  sheet  you  have  labeled 
"Example. " 

6.  Have  the  participant  read  the  example  of  how  to  use  the  flowchart  contained 
in  the  User's  Guide.  Tell  the  participant  to  comment  when  anything  is  unclear. 
List  comments  on  the  observation  form,  recording  the  number  of  the  direction 
the  comments  refer  to. 

7.  When  the  participant  finishes  with  the  example,  record  the  time  at  the 
bottom  of  the  form  you  are  on  and  at  the  top  of  the  sheet  you  have  labelled 
"Objective  1." 

8.  Show  the  participant  the  first  objective.  Instruct  him  to  use  the  model  to 
select  the  appropriate  media  to  teach  it.  Have  him  use  the  other  information 
listed  with  the  objective  as  well.  Have  him  use  his  own  judgement  where  answers 
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to  questions  are  not  given.  Instruct  the  participant  to  think  out  loud  and 
explain  each  decision  he  makes,  also  to  ask  questions  or  make  any  suggestions 
he  may  have.  Tell  him  he  may  write  comments  on  the  flowchart. 

9.  On  this  and  all  passes  through  the  model,  record  your  observations  and  the 
participant's  comments  on  the  observation  form.  Reference  decisions  by  number  in 
the  column  at  the  left  on  the  observation  form.  Always  have  the  participant  start 
with  Chart  A. 

10.  Always  ask  questions  when  there  is  a  divergence  from  the  ideal  path  noted  on 
the  formative  evaluation  JPA.  Obtain  an  adequate  understanding  of  why  the  par¬ 
ticipant  went  the  way  he  did.  Don't  let  the  participant  see  the  listing  of 

the  ideal  path  while  he  goes  through  the  model.  Also,  be  sure  to  record 
every  occasion  the  participant  refers  to  the  detailed  directions  in  the  User's 
Guide. 

11.  When  the  bottom  line  is  reached,  record  the  stop  time  and  the  letter  of  the 
box  selected  at  the  bottom  of  the  observation  form.  Have  the  participant  use  the 

i  ) 

Media  Selection  Worksheet.  If  the  participant  deviated  from  the  correct  path,  go 
back  to  the  point  of  divergence  and  have  him  proceed  again  using  the  correct  deci¬ 
sion  at  that  point. 

12.  For  each  objective,  have  the  participant  go  through  the  final  selection  proce¬ 
dure.  Start  with  a  clean  observation  form  labelled  "FSP"  and  the  objective  number. 
Have  him  assume  the  production  constraints  are  like  those  he  would  typically 
encounter  in  his  work.  Say  that  each  objective  should  be  treated  as  if  it  were 
part  of  a  set  of  objectives  for  an  entire  course.  Use  the  Flowchart  and  User's 
Guide  instruction  numbers  and  letters  as  references  on  the  observation  form.  Keep 

,  any  pertinent  notes  the  participant  makes  in  nis  final  decision. 
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13.  Before  going  to  the  next  objective,  ask  the  participant  if  he  would  really  be 
likely  to  use  the  media  he  selected  If  he  were  actually  asked  to  design  Instruction 
for  the  objective. 

14.  After  performing  step  13,  set  aside  the  forms  for  the  objective  you  have  been 

working  on  and  go  to  the  next  one.  Repeat  steps  8  through  13  for  the  remaining 

objectives. 

15.  Have  the  participant  fill  out  the  attitude  questionnaire. 

16.  While  the  participant  fills  out  the  questionnaire,  check  that  each  set  of  the 
forms  you  filled  out  is  in  order.  Place  all  the  sets  of  forms  for  this  participant 
together  in  one  stack. 

17.  Look  over  the  attitude  questionnaire  when  it  is  complete  and  ask  for  any 
clarifications  of  the  answers.  Ask  follow-up  questions  based  on  the  answers. 

Record  the  answers  to  your  follow-up  questions  on  the  back  of  the  questionnaire. 

18.  Thank  the  participant  for  his  time  and  the  usefulness  of  his  responses. 


Formative  Evaluation  JPA* 

1.  Explain  what  we  are  doing 

2.  S  reads  What  you  need  and  How  to  Proceed  (pp.  1  &  2  of  flowchart) 
Kote  comments. 

3.  £  reads  Example  of  How  to  Use  Flowchart.  Note  comments. 

4.  S  talks  aloud  while  using  flowchart  for  objective  1.  Note 
comnents. 

5.  uses  MS  Worksheet  to  record  candidate  media.  Note  comments. 

6.  uses  final  selection  procedure  for  objective  1.  Note  comments. 

7.  Ask  S  if  he  would  really  use  media  selected.  Note  comments. 

8.  Repeat  steps  4-7  for  objectives  2-6. 

9.  fills  out  attitude  questionnaire. 

10.  Ask  follow-up  questions  re  questionnaire  responses.  Note  comments 
Paths 

1.  A.l  &  F.l 

2.  0.3  or  D.4  (or  F.4  or  F.5) 

3.  A. 41  &  E.l  (or  C.l) 

4.  B.3,  D.3,  or  F.3 

5a.  0.2  or  F. 2 

5b.  0.3  or  F.3 

6.  A.l  &  B.l 


*N0TE:  This  JPA  was  used  by  CET  staff  members  during  the  formative 
evaluation  sessions. 
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Objectives  Used  During  the  Formative  Evaluation  Sessions* 

Directions:  Use  the  Media  Selection  Flowchart  to  choose  appropriate 
media  to  teach  the  following  objectives. 

Objective  1:  From  a  height  of  5  feet,  exit  a  hovering  helicopter  and  land 
on  the  ground  without  Injury. 

(This  objective  Is  a  Motor  Skill  Intended  for  trainees  who  cannot 
read. ) 

Objecltve  2:  Name  two  Army  NBC  devices  and  state  how  often  each  should  be 
Inspected  or  serviced. 

(This  objective  Is  a  Verbal  Information  objective  Intended  for 
trainees  who  cannot  read.f 


Objective  3:  Perform  mouth-to-mouth  resuscitation  and  external  heart 
massage. 

(This  objective  is  a  Motor  Skill  intended  for  trainees  who  can  read.) 

Objective  4:  Choose  to  exhibit  a  positive  disposition  about  being  in  the 
Army. 

(This  objective  is  an  Attitude.  Intended  for  all  trainees.) 

Objectives  5a  &  5b  (Note:  The  two  objectives  below  are  to  be  taught  as 

part  of  the  same  lesson.): 

5a.  Identify  the  grid  square  of  a  point  on  a  map. 

(This  objective  Is  a  Mental  Skill  intended  for  trainees  who  cannot 
read. ) 

5b.  Choose  to  use  a  straight  edge  when  drawing  lines 
on  a  map. 

(This  objective  is  an  Attitude  intended  for  trainees  who  cannot  read.) 

Objective  6:  Classify  Incoming  radar  signals  as  friendly  or  hostile. 

(This  objective  is  a  Mental  Skill  designed  to  be  taught  in  a  broadcast 
setting. ) 


♦NOTE:  The  information  listed  here  is  presented  in  the  form  In  which  It 
was  presented  to  participants  during  the  formative  evaluation  sessions. 


OBSERVATION  FORM 


Appendix  G 

Summary  of  Attitude  Data  Collected  at  Fort  Gordon 
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Attitude  Questionnaire 

Data  from  Fort  Gordon 
(N-6) 


A  a  Strongly  Agree 
B  =  Agree 
C  =  Neutral 
D  =  Disagree 
E  =  Strongly  Disagree 


1.  Use  of  this  model  seems  to  result  in  media 
choices  appropriate  for  the  task  to  be  trained. 

2.  The  amount  of  time  spent  in  using  the  model  is 
justified  by  the  results. 

3.  The  language  in  the  model  is  appropriate  for 
the  people  that  will  be  using  it. 

4.  The  "flowchart"  format  of  the  model  is  con¬ 
venient  to  use. 

5.  The  definitions  of  the  categories  of  media  are 
appropriate  for  military  applications. 

6.  The  procedures  for  using  the  model  are  easy  to 
learn. 


media. 


ABODE 

3  3  0  0  0 

4  10  10 

14  0  10 
6  0  0  0  0 

2  4  0  0  0 

3  2  0  1  0 


fci 

7. 

The  number  of  decisions  necessary  to  select  a 

medium  (media)  are  manageable. 

3 

3 

0 

0 

0 

¥ 

'A- 

8. 

The  fold-out  format  is  a  convenient  way  to 

package  the  model . 

5 

1 

0 

0 

0 

9. 

The  probability  that  the  model  will  be  used  on 
the  job  is  high. 

1 

1 

4 

0 

0 

f-i 

t':-! 

if  i 

■:i. ! 

10. 

A  media  selection  model  should  be  used  when 
choosing  instructional  media  for  use  in  the 

;;  i 

mil itary. 

2 

4 

0 

0 

0 

11. 

The  model  includes  most  of  the  Important 
questions  that  should  be  asked  when  selecting 

2  4  0  0  0 
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Attitude  Questionnaire 


Data  from  Fort  Rucker 
(N-5) 


A  ■  Strongly  Agree 
B  =  Agree 
C  =  Neutral 
D  «  Disagree 
E  =  Strongly  Disagree 


ABC 

1.  Use  of  this  model  seems  to  result  In  media 

choices  appropriate  for  the  task  to  be  trained.  320 


2.  The  amount  of  time  spent  in  using  the  model  is 

justified  by  the  results.  311 

3.  The  language  in  the  model  is  appropriate  for 

the  people  that  will  be  using  It.  220 

4.  The  "flowchart"  format  of  the  model  is  con¬ 
venient  to  use.  410 

5.  The  definitions  of  the  categories  of  media  are 

appropriate  for  mi  I itary  applications.  3  11 

6.  The  procedures  for  using  the  model  are  easy  to 

learn.  410 


7.  The  number  of  decisions  necessary  to  select  a 

medium  (media)  are  manageable.  410 

8.  The  fold-out  format  is  a  convenient  way  to 

package  the  model .  410 

9.  The  probability  that  the  model  will  be  used  on 

the  job  is  high.  221 

10.  A  media  selection  model  should  be  used  when 
choosing  Instructional  media  for  use  in  the 

military.  311 

11.  The  model  Includes  most  of  the  Important 
questions  that  should  be  asked  when  selecting 
media. 
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